Converting Text into Agent Animations: Assigning Gestures to Text
نویسندگان
چکیده
This paper proposes a method for assigning gestures to text based on lexical and syntactic information. First, our empirical study identified lexical and syntactic information strongly correlated with gesture occurrence and suggested that syntactic structure is more useful for judging gesture occurrence than local syntactic cues. Based on the empirical results, we have implemented a system that converts text into an animated agent that gestures and speaks synchronously.
منابع مشابه
Learning to Gesticulate: Applying Appropriate Animations to Spoken Text
We propose a machine-learning system that learns to choose amongst human-like gestures to accompany novel text. The system is trained on scripts (which are comprised of speech and animations) that were hand-coded by professional animators and shipped in games built on top of the Source game engine. The system first extracts features from the text that was spoken, and maps these features to the ...
متن کاملAutomating the Creation of 3d Animation from Annotated Fiction Text
This paper describes a strategy for automatically converting fiction text into 3D animations. It assumes the existence of fiction text annotated with avatar, object, setting, transition and relation annotations, and presents a transformation process that converts annotated text into quantified constraint systems, the solutions to which are used in the population of 3D environments. Constraint s...
متن کاملAutonomous Speaker Agent
Autonomous Speaker Agent is a graphically embodied animated agent (a virtual character) capable of reading plain English text and rendering it in a form of speech, accompanied by the appropriate, natural-looking facial gestures. The system uses lexical analysis and statistical models of facial gestures in order to generate the gestures related to the spoken text. It is intended for the automati...
متن کاملGenerating Culture-Specific Gestures for Virtual Agent Dialogs
Integrating culture into the behavioral model of virtual agents has come into focus lately. When investigating verbal aspects of behavior, nonverbal behaviors are desirably added automatically, driven by the speech-act. In this paper, we present a corpus driven approach of generating gestures in a culture-specific way that accompany agent dialogs. The frequency of gestures and gesture-types, th...
متن کاملSign language communication between Japanese-Korean and Japanese-Portuguese using CG animation
In this paper we propose a sign language communication between different languages such as Japanese-Korean and Japanese-Portuguese using CG animation of sign language based on the intelligent image communication method. For this purpose sign language animation is produced using data of gesture or text data expressing sign language. In the production process of CG animation of sign language, MAT...
متن کامل